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Abstract We consider the problem of approximately solving a standard bi-quadratic programming (StBQP), 
which is NP-hard. After reformulating the original problem as an equivalent copositive tensor programming, 
we show how to approximate the optimal solution by approximating the cone of copositive tensors via a serial 
polyhedral cones. The established quality of approximation shows that, a polynomial time approximation scheme 
(PTAS) for solving StBQP exists and can be extended to solving standard multi-quadratic programming. Some 
numerical examples are provided to illustrate our approach. 
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1 Introduction 


We consider a polynomial optimization problem of the form 


P™ = minp^{a:,j/) := E E 

i,j = l k,l=l 
S.t. X G y ^ 


( 1 . 1 ) 


where 

/is := G 5R+ j ^ Zi = I 

is the standard simplex and denotes the non-negative orthant in s-dimensional Euclidean space 5R®. Here, 
A := {aijki)i<ij<n,i<kg<m is a real (2, 2)-th order nxnxmx m-dimensional tensor. Without loss of generality. 
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we assume that the tensor A satisfies the following symmetry condition: 

^ijkl ^jikl ^ % j h^l (f-2) 

We call the tensor satisfying (1.2) is partially symmetric. It is easy to see that, in case where all are 
independent of the indices k and Z, i.e., = 6^- for every i,j = 1,... ,n, the original problem (1.1) reduces 

to the following standard quadratic programming (StQP) 

n 

/min = min f{x) := 'V' hjXiXj, 

.5^1 (1-3) 

S.t. X G An. 

Hence, the problem (1.1) is called a standard bi-quadratic programming (StBQP). StQP not only occur frequently 
as subproblem in escape procedures for general quadratic programming, but also have manifold applications, 
e.g., in portfolio selection and in maximum weight clique problem for undirected graphs. For details, see, e.g. 
[1,5,14,18] and references therein. If we consider portfolio selection problems with two groups of securities 
whose investment decisions influence each other, then a generalized mean-variance model can be expressed as 
a StBQP, see [4] for details. In that paper, some optimality conditions of StBQP were studied, and based upon 
a continuously differentiable penalty function, the original problem was converted into the problem of locating 
an unconstrained global minimizer of bi-quartic problem. 

In terms of it is easy to see that the objective function in (l.I) can be written briefly as 

PA{x,y) = [Axx^) • {yy^) = [yy^A) • (xx^), 


where 

/ " 

Axx^ = I ^ a^jkmxj 
\*j=i 

are two mx m and n x n symmetric matrices, respectively, and X •¥ stands for usual Frobenius inner product 
for matrices, i.e., X •¥ = tr{X^¥). 

The problem of solving (1.1) is NP-hard, even if the objective p is a quadratic function, see [2,16,17]. 
Therefore, designing some efficient algorithms for finding approximation solutions of (1.1) is of interest. In [13], 
some approximation bounds for the standard bi-quadratic optimization problem were presented. Moreover, by 
using the variables zf and Wj to replace Xi and yj respectively, the original problem can be rewritten as 


and yy^A = ^ o.ijkiykyi 


l<kd<r 


.k,l=l 


l<2j<n 


n m 

minp( 2 ,w):= ^ ^ Oijkizfz]wlwf 
ij = l k,l = l 

s.t. I|2f = l, jjwf = 1, (2,w;) G K" X K"". 


Base on this, a polynomial-time approximation algorithm with relative approximation ratio was studied, the 
obtained result is a bi-quadratic version of that presented in [11,24]. It is well-known that StQP does allow a 
polynomial time approximation scheme (PTAS), as was shown by Bomze and De Klerk [2]. For the more general 
minimization of polynomial of fixed degree over the simplex, De Klerk, Laurent and Parrilo [8] also showed the 
existence of a PTAS. Recently, by using Bernstein approximation and the multinomial distribution, a new proof 
of PTAS for fixed-degree polynomial optimization over the simplex was presented, see [9] for details. Indeed, 
in the case where feasible set is single simplex, the PTAS is particularly simple, and takes the minimum of / 



Error analysis of approximation algorithm for standard bi-quadratic programming 


3 


on the regular grid An{r) = {x £ An \ (r + 2)x £ N"} for increasing values of r e N. Denote the minimum over 
the grid by 

f’^'> = min {f{x) I X £ An{r)}. 

It is obvious that the computation of requires |Z\„(r)| = evaluations of /. 

Moreover, we see that the regular grid mentioned above play an important role in the implement of PTAS. 
Several properties of the regular grid An(r) have been studied in the literature. In Bos [6], the Lebesgue constant 
of An{r) is studied in the context of Lagrange interpolation and finite element methods. Given a point x £ An, 
Bomze, Gollowitzer and Yildirim [3] study a scheme to find the closest point to x on An(r) with respect to 
certain norms (including .^q-norms for hnite g). Furthermore, for any quadratic polynomial / and r G N, Sagol 
and Yildirim [23] and Yildirim [26] consider the upper bound on /min defined by min^-gur A„(k)f(^)j ^'iid 
analyze the error bound. The following error bounds are known for the approximation ' of /. 


Theorem 1.1 (i) [2] For any quadratic polynomial f and r G N, one has 


/■G) _ /■ . < 

JA Jmin ^ 


1 


r + 2 


(/max /min) 5 


where /max is the maximum value of the objective in (1.3). 

(a) [8] For any homogeneous polynomial f of degree d> 2 in (1.3) and r £ N\{0}, one has 


r(d+r-2) 

J A 


/min < (1 - Wr{d)) 


2d - 1 
d 


d (/max — /min): 


where Wr{d) = 

The above results imply the existence of a PTAS for the corresponding optimization problems. This naturally 
raises the question of whether the same holds for StBQP. As far as we know, there are very few PTASs for solving 
standard bi-quadratic optimization problems. Indeed, the appearance of Cartesian product of two simplices in 
(1.1) results in that the designing PTAS becomes a more complex task, which also differs from the problems 
considered in [2,8]. 

In this paper, we focus on approximately solving StBQP, and present a quality of approximation which 
shows the existence of a PTAS for solving StBQP. Moreover, we prove that the proposed approach can be 
extended to solving standard multi-quadratic optimization problem. Some numerical examples are provided to 
illustrate our approach. 

Some words about the notation. 5R" denotes the real Euclidean space of column vectors of length n, and 
N” denotes the set of all nonnegative integer vectors of length n. For a = (ai,...,an)^ € N” and d G N, 
we dehne jaj = qi -|-02 + • • ■ + an, = ai\a 2 \■ ■ ■ oin\ and I{n,d) = {q G N” j jaj = d}. For two vectors 
a,/3 G K", the inequality a < P is coordinate-wise and means that < pi for every i. Denote by the 

set of all (d, /)-th order nx---xnxmx---x m-dimensional real rectangular tensors, and Snfm the set of 

d i 

all partially symmetric tensors in T^’m- Here, the meaning of partially symmetric is similar to that in (1.2). 
Specially, if d = Z = 2, Tn’m and Snfm are simply written as Tn,m and Sn,m, respectively. For x G 5R”, denoted 
by the tensor (x^^ • • • Xi^)i<ij_.,,y^<„, which is a d-th order n-dimensional square tensor. For given X £ Tn 
(the set of all d-th order n-dimensional square tensors) and y £ Tm, denoted by A (g) T the (d, Z)-th order 
nx---xnxmx---x m-dimensional real rectangular tensor with entries for 1 < ii,... ,i^ < n 
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and I < ji, ■ ■ ■ ,ji < m. Denote by £ the tensor of all ones in an appropriate tensor space. We denote hy A* B 
the Frobenius inner product for tensors A,B € T^’m, i-e., 


E E 




Let T-Lnjm denote the set of all bi-homogeneous polynomial of degrees d > 2 and I > 2, with respect to the 
variables x G K" and y G K™ respectively. 


2 Preliminaries 

Recall that a set 5 C K" is said to be convex if whenever x,y ^ S and t G [0,1] we have tx + [I — t)y G S'. A set 
A C K" is said to be convex cone, if K is convex and whenever x £ K and t > 0 we have tx G K. Let F be a 
hnite dimensional vector space equipped with a inner product (•,•), and let A be a convex cone in V. Denote 

K* = {w£V \ {w,k) > 0,V A: G A}, 

which is said to be the positive dual cone of A. 

For a given cone A and its dual cone A*, we define the primal and dual pair of conic linear programs: 

(P) p*:=infC'»A 

s.t. A G A, Ai • A = i = 1, 2,..., m 

and 

(D) d* ■= sup y 

s.t. 

The following well-known conic duality theorem, see, e.g., [22], gives the duality relations between (P) and (D). 

Theorem 2.1 (Conic duality theorem). If there exists an interior feasible solution G int{A) of (P), and a 
feasible solution of (D), then p* = d* and the supremum in (D) is attained. Similarly, if there exist G 5R"* with 
^ ~ "YllLi G int(A*) and a feasible solution of (P), then p* = d* and the infimum in (P) is attained. 

We now introduce the concept of copositive rectangular tensers, which is a generalization of the concept of 
copositive square tensors presented in [21] and studied in [25]. 

Definition 2.1 Let Q = G Sn]m- We say that 5 is a (resp. strictly) copositive tensor, if 

n m 

E E 9h...idh...jAii ■ ■ • XidVji (resp. > 0) 

ij = l k,l=l 

for any {x,y) G 5R" x K™ (resp. {x,y) G (5R"\{0}) x (5R!p\{0})). 

Denote by ‘ifnlin the set of all copositive tensors in Sn^rn- It is easy to see that is a closed convex cone 
in the vector space Tn(m- The copositive cone in Sn,m is simply defined by '^n,m. 

Proposition 2.1 Let A G Sn,m. Then 

(i) A is copositive, if and only if p^^ > 0. 

(ii) A is strictly copositive, if and only if p^^ > 0. 
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Proof Since x := xf ^ and y := yf Vj ^ for any x € K!(:\{0} and y G 5R!p\{0}, the desired 

results follow from Definition 2.1. □ 


Proposition 2.2 For any given positive integers n, m, d, Z € N with d,l > 2, one has 

c/pdg _ / \* 

On,m — \^n,mj j 

where = conv{a:'^( 8 )y* | x G 5R" , y G K™} which is called the cone of all partially symmetric completely positive 

tensors in Tn'ln■ 

Proof Let A G For any x'^ ®y^ G it is obvious that 

n m 

A»{x‘^®y)= ^ ^ a^^...i^J^...J^Xi^■■■x^^yj^■■■yp>Q, 

by Definition 2.1. Based upon this, we may know that .4 • S > 0 for any B G which implies that 

.4 G Hence, <i C 

Now we prove ^ Let A G {ti§n!m)*■ Suppose that A ^ '^nfm- Then there exist x G 5R" and 

y G 5R!p, such that 

n m 

■ ■ ■ Wfi < 0 - 

Take 2 = x'^igiy^. Then 2 G From the above expression, we see that A* 2 <0, which is a contradiction. 

Therefore, A G ‘cFnfrn, which implies that 2 ’Wnfm- Q 


We consider the following conic optimization problem 


V 


p 

min 


= min A* 2 


S.t. 2 G 


£•2 = 1 


( 2 . 1 ) 


with tMn,m = whose dual problem is 

r^max — ^4? 

AG5R 

S.t. ^ — \E ^ ^n,m 


( 2 . 2 ) 


It is clear that for every feasible pair {x, y) of (1.1), one has that xx^ ®yy^ G t^n,m and £ • {xx^ ®yy^) = 1. 
Hence, the problem (2.1) is a tensor program relaxation of (1.1), which implies that < ^( 4 '"- However, the 
following theorem shows that this relaxation is exactly tight, and the solving ( 1 . 1 ) can be converted equivalently 
to the solving ( 2 . 1 ). 


Theorem 2.2 The bi-quadratic optimization (1.1) and conic optimization (2.1) are equivalent, that is, (1.1) and 
(2.1) have the same optimal value and one optimal solution pair of (1.1) can be obtained from the optimal solution 
of (2.1). 

Proof Let 2* be an optimal solution of (2.1) with the objective value By the definition of TSn,m, there exists 
a positive integer t such that 2* = ® ) with G K+\{0} and G K+\{0}, 

fc = l,...,t. Let Afc = {^T=iyf^') ■ Then A/, > 0 for fc = 1, 2,. .., t, as well as Yl\=i^k = 1 

since £ • 2* = \. Moreover, it is easy to see that 2* = Afc(x*'^^(x*'^^)^) ® {y^^'^)^), where = 
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a;('=VE"=i*fc^^ G An and EjLi ^ Since = A»Z*,it follows that = ELi^fc-^* 

(8) which implies that there must exist an index, say 1, such that 

(2.3) 

since > 0 for k = 1,... ,t and Efe=i = 1- On the other hand, since G An and G Zim, it is clear 
that 

P™ < Pa{x^^\v'"^'’) =A» » (y^'^^y'-^^)^)], 

which implies, together with (2.3) and the fact that < p^'", that p)^'" = Al»[{i^^^(iO))T^)(g)(y(i)(y(i))T^)] = 
^min- obtain the desired result and complete the proof. □ 

For the linear tensor conic optimization problems (2.1) and (2.2), by utilizing Theorem 2.1, we obtain 
the following duality result, which means, together with Theorem 2.2, that there exist no polynomial time 
algorithms for solving (2.2). 

Theorem 2.3 For the conic optimization problems (2.1) and (2.2), one has = Vmax- 

Proof In order to invoke Theorem 2.1, we have to show that there is a A G K with Al— Af G int(.^^ „j) = int('^ri,m), 
and that there is a feasible solution of (2.1). 

Take A G 5R such that ^ := Al — A£’ is positive tensor, i.e., all entries of Al — Af are positive, which implies 
that A is strictly copositive. Hence Al — Af G int('^„,m) = mt{.3§n^ni)- 

On the other hand, by taking Z = ;j2^e*'"^(e^"^)^ (g) e*'™^(e*''"^)^ G ^n,m, where e*-”^ and are the two 
vectors of all ones in 5R" and K™ respectively, we may verify that S»Z = 1, which means .E is a feasible solution 
of (2.1). By Theorem 2.1, we obtain the desired result. □ 


3 Approximation of copositive tensor cones 


Copositive programming is a useful tool in dealing with all sorts of optimization problems. However, it is well- 
known that the problem of checking whether a symmetric matrix belongs to the cone of copositive matrices 
or not is co-NP-complete [15]. The appearance of copositive tensor in (2.2) results in the considered problem 
becomes a more complex task, since copositive tensor hides more complex structures than matrix in terms of 
computational solvability. In this section, we focus attention on studying how to approximate the copositive 
tensor cone ‘^n 

By virtue of pg{x,y) in (1.1) with Q G Sn,m, we define 


pis,A 


{x,y) 


PG{x,y) 




(3.1) 


where s and r are any given non-negative integers. We consider when P^’'^\x,y) has no negative coefficients. It 
is clear that the set of all partially symmetric tensors Q satisfying this condition forms a convex cone in Sn,m- 


Definition 3.1 The convex cone '^n^ consists of the tensors in Sn,m for which P^‘^’^\x,y) in (3.1) has no 
negative coefficients. 


Obviously, these cones are contained in each other: "^njm fk kk for all non-negative integers s 

and r. The approximation of “^n^ to ‘^n,m is essentially by examination of the proof of the following theorem, 
which is a bi-quadratic version of the famous theorem of Polya [10,19] (see also Powers and Reznick [20]). 
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Theorem 3.1 LetQ G Sn,m andpg{x,y) be a bi-quadratic form defined in (1.1). Suppose thatpg{x,y) is positive on 

^3 = 


the Cartesian product of two simplices An x Am, i.e., p™ > 0 . Then the polynomial pg{x,y){J27=i^iyiYl]Liyjy 


has non-negative coefficients for all sufficiently large integers r and s. 
Proof In terms of I{n,2) and 7(m,2), we rewrite pg{x,y) in (1.1) as 


PG{x,y)= 


QG/(n,2),/3G/(m,2) 


x°‘y^ 


(3.2) 


that is, Pap = Papci\p\. Define 


cj>{x,y,t,s) = ^ Pap 

aG/(n,2),/3G/(m,2} 


(*l)r •••(*»)?" (j/l)^---(i/m)f" 


a\j3\ 


where (a)® := a(a — t) ■ ■ ■ (a — [q — l)t) with [a,t,q) G K x 5R+ x N. It is clear that <)>(a;, t/, 0,0) = p{x,y), and (p 
is continuous in An x Am x [0,1] x [0,1]. Consequently, by the given condition, there exist positive numbers p 
and £ G [ 0 , 1 ], such that 

(p{x, y, t, s) > (pix, y, 0, 0) - (l/2)p > (l/2)p > 0 (3.3) 

for {x,y,t,s) G An X Am x [ 0 ,e] x [ 0 ,£]. 

On the other hand, we also have that for any s, r > 2, 

o / \ s—2 


Z]®*) = (r- 2 )!(s- 2 )! ^ 


Vi=i 


7 G/(n,r—2),AG/(m,s —2) 


ylA! ■ 


(3.4) 


By multiplying (3.2) and (3.4), we obtain 


Pgix,y)(j2^A Z^J = (r- 2 )!(s- 2 )! ^ ^ p^p 


u = l 


Q:G/(n,2) 7 G/(n,r—2) 
/3GJ(m,2) AG/(m,s —2) 


a-a+T^+A 

')\\\a\p\ 


Denote a + 7 = ^ and /? + A = C Then, it holds that ^ G /(n, r) and f G I(m, s). Moreover, it is not difficult to 
see that 

s-2 

XWC' 


x^y^ 


P 6 (*,y)(Z ®0 iZs^Jl = (r'- 2 )!(s- 2 )! ^ 

^G/(n,r) aG/(n,2) 


Z 


u=i 


a \ P 


(3.5) 


a<«,/3<C 


where (|) = (p) = p!(C-P)r O = 0 ^^y a, 6 G N with & < a, by (3.5), we have 




Pel 


Z®0 Z^/J 


U=i 


= (r-ms-2)! Z # Z 


C!C! 

^Gl(n,r) aGl(n, 2 ) 




(Gl(m,s) /3Gl(m,2) 

= (r- 2 )!(s- 2 )!r^s^ ^ p(^/r, (/s, 1 /r, 1 /s) 

^el{n,r) 

Cel{m,s) 


x^y‘’ 

w 


Since, p here is positive for sufficiently large r and s by (3.3), we obtain the desired result and complete the 
proof. □ 
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For every A4 € %i,m, we claim that A4 € "ifn’m for sufficiently large s and r. In fact, it is clear that 
A4t := A4 +1£ is strictly copositive for any t > 0, which implies > 0 by Proposition 2.1. Consequently, by 
Theorem 3.1, we know that Mt lies in some cone 'ifn’m for s,r sufficiently large. Since ‘^n’m is closed for any 
fixed s and r, by letting t > 0, we know that A4 € 'ifn’m for sufficiently large s and r. 

For given a € K", dehne 


c(a) 


^ if Q G N", 


0 , otherwise. 


(3.6) 


Moreover, for given ^ G K", C C 3?”^ and Q G Sn,m, define 


<3«(5)=E 12 {3.7) 

i,j = l k,l=l 


where j) = ^ — for G 3?", and for G 3?"*. Here, 

is the i-th column vector of the identity matrix in 
By the multinomial law, it holds that 


D(s.r) 


i3:,y) 


n m 


= X! XI dijkiXiXjVkyi X X ^9 


k,l=l 


,p=l 


9=1 


Irl 


L. 9^3kl^^x^X:^ymx 2 /^ 


Oi£l{n,s) 0^1{m,r) i,j = l k,l=l 
n m 

= X XXX 3^3kl 

aGl{n,s) i,j = ^ k,l=l 


aipV 


q!/3!‘ 


0 !+e^"'+e*"' /3+e^'"'+eJ’"' 


X X 

{G/(n,s+2),{(")(i,9)>0 CG/(m,r+2),C<™Hfc.0>0 


X X 

i,j = l k,l = l 


«?!r! 




x^y'^ 


= X X 

{G/(n.s+2) CG/(m.r+2) 

= X X Qid^)^^y 

^G/(n,s+2) Ce-/'(m,r+2) 


n ra 


X X 9i3ki<3{^^'^\i.j))c{6'^\k,l)) x^y^ 


ij = l k,l = l 


(3.8) 


where the last second equality is due to (3.6), and the last equality comes from (3.7). From (3.8), we see that 
Q^ciG) as given by (3.7), are exactly the coefficients of 

For Q G Sn,m, denote by (i = l,...,n) the mxm symmetric matrix with entries being gm^i (k,l = 
1 ,2 ,..., m), (fc = 1,... ,m) the n X n symmetric matrix with entries being giji-k {hj = 1)2,... ,n), and C 
the nxm matrix with entries being gukk (i = 1, ..., n. A: = 1, 2,..., m). The following auxiliary result simplifies 
the expressions Q^q{Q) considerably. 


Lemma 3.1 Let Q G Sn,m, i G I(n, s + 2) and G I{m, r + 2) . Let be defined in (3.7) . Then, 


= 


(s + 2 )(s+l)(r + 2 )(r + l) 




k=i 


(3.9) 


where c(-) is defined in (3.6). 
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Proof It is easy to verify that, if j) G then j)) = 0; otherwise, we have 




c(C) 


(s + 2) (s -|- 1) 


otherwise. 


(s + 2) (s -|- 1) 

Similar result on ^-Iso holds. Consequently, by (3.7), it holds that 

c^(e^-l)Cfe{Cfe-l) 


Q«c(5) = 


l< 2 <n l<fc<r: 


(s-h2)(s-hl)(r-h2)(r + l) 

- l)CfcC; 


gukkciO^iO 
^9iikic{0c{0 


(s-h 2 )(s-t-l)(r-h 2 )(r-|- 1 )' 

l<i<n l<fc^Z<m ^ ’ 

^ ^ (s -h 2)(s + l){r -h 2)(r -f i) 5»jfcfcc(e)c(C) 

^ ^ (s + 2)(s + l)(r + 2)(r -h 1) ^?rifelc(Oc(C) 


c(C)c(C) 


{s-h2)(s-hl)(r + 2)(r-hl) 


E E dijkl^i^jCk Cl E E diiklCi Ck Cl 

l< 2 ,j<n l<fc,Z<m l<z<n l<fe,Z<m 


- E E QijkkCiCjCk H“ E E diikkCiCk / ? 

1</L<m l<Z<n l<fc<m J 

which exactly corresponds to (3.9). 

It is not difficult to see that, when Q = 8 £ Sn,m, for any ^ ^ /{n, s + 2) and ( £ /(m, r + 2), one has 

Q «(0 = c(Cc(C), 

since in this case, by a simple computation, we have 

E E dijkiiiijikQ = (s + 2 )^(r -h 2 )^, guki^iCkCi = (s + 2 )(r + 2 )^, 

l<fc,Z<m l<i<n l<fe,Z<m 

and 

E E gijkk^i^jCk = {s + 2f{r + 2), y^ y^ gizkk^iCk = {s + ‘2){r + 2). 

lKk<m l< 2 <nl<fe<m 

Based upon Lemma 3.1, we can immediately derive a polyhedral representation of the cones 
Theorem 3.2 For all n, m,s,r £ N, one has 

= \g& Sn,m I (eed) • (cc^) -y^Cz(d^^*k) 

I i=l 

m '\ 

- E + dec > 0, for all C G /(n, s + 2), C G /(m, r + 2) I , 

k=l ) 

where (i = 1 ,..., n ), (fc = 1,... ,m) and C are defined before Lemma 3.1. 


□ 


(3.10) 


Proof It follows from (3.8) and (3.9). The proof is completed. 


□ 
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From Theorem 3.2, we know that 

= {G € Sn,m \ G • » (CC^) - Diag(C) » (CC^) “ ® Diag(C) 

+Diag(^) (g) Diag(C)] > 0, for all f e /(n, s + 2), C £ I{m,r + 2)}, 


and hence 

«;m)* D ® (CC^) - Diag(0 <8) (CC^) - ® Diag(C) 

+Diag(5) (g) Diag(C) | C ^ I{n,s + 2)X £ /{m,r + 2)} ^ 0. 


4 Quality of approximation 


For any given non-negative integers s, r G N, define 


mm{A» X \ £ • X = 1,X € (4.1) 

which has dnal problem 

max{A I Af £ £ K} . (4.2) 

By taking ^ = (s -|- 2, 0,..., 0)^ £ 7(n, s -|- 2) and ( = (r -|- 2,0,..., 0)^ £ I{m, r + 2), we may find a feasible 
point of (4.1). On the other hand, it is obvions that there exists a A G 5R such that all elements oi A —\£ are 
positive, which implies A — \££ int(‘^,^^m). By Theorem 2.1, we know that the optimal value, denoted by 
of (4.1) equals to one of (4.2). Moreover, we know that problem (4.2) is a relaxation of problem (2.2), in which 
the copositive cone '^n,m is approximated by in the sense that every A4 G must lie in some cone 

'^n’m for sufficiently large s and r. It therefore follows that < ^( 4 '" for all sufficiently large s,r. We now 

provide an alternative representation of ■ This representation uses the following two rational grids which 
approximate the standard simplices An and Am in ( 1 . 1 ): 

An{s) := G Zin I (s + 2)x G N”} and Am{r) := {y G Am \ (r -|- 2)y G N™} . 

Consequently, a natural approximation of problem (1.1) would be 

:= min{p^(a;,y) | x G An{s),y G Am{r)} , (4.3) 

which satisfies 

We now establish the connection between p^''~'* and 


Theorem 4.1 For any given s,r G N. We consider the rational discretization An{s) x Am{r) of An x Am- If 
A G Sn,m, then 

niin{p^(a;,p) | xG An{s),y G Am{r)} , (4.4) 


where 


with 


{s + l)(r -h 1) 

n m 

Pa{x, y) ■■= Pa{^^ y)-'Y^ ^ ykX^ A'^^'^x X Ay 


k=l 




A = 


(s + 2){r + 2) 


l<2<n,/</c<m ■ 
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Proof By putting Q = A — XS, we have 

QiciS) = — XQ^i^{S) 

= c(?)c(C) 


(. + 2)(. + l)(. + 2)(, + l) ' '«"> - <• + 2) gs.K-^lOc) 

-(r + 2)f^ + {s + 2)(r + 2)C^iC ) - a| , 


k=l 


where the second equality comes from (3.9) and (3.10). Consequently, by (4.2) and Theorem 3.2, we have 


(s,r) 

= 


(, + 2 )(. + l)(r + 2 )(r + l) "^" | • (Cd) " + 2 ) E 

m \ 

-(r + 2)^Cfc(dd'=)0 + (« + 2)(r + 2)dy | ^eI(n,s + 2), C€l{m,r + 2)\, 


k=l 


which implies that (4.4) holds, by putting x = and y = y^C- We complete the proof. □ 

From Theorem 4.1, we see that can be obtained by only function evaluations at points on the rational 

grid An{s) X Amir), which could help us obtain more easily than doing so by (4.2) directly. 

Now we present our main result in this paper. 

Theorem 4.2 Let p^^ = max{pyi(a:, y) | x £ An, y € Am}- One has 

s + r + A 


min (^»^) ^ s-hr-h4 

f max min'\ 

PA ^ (, + !)(, + !) -P-4 ) 


and 


(s,r) min - S + r -|- 4 


max min \ 

Pa -pa ' 




Proof It is obvious that Uii/cfc = PA{^i^\^^'^) ^ Pa^’^ every i = 1,... ,n and k = 1,... ,m, which implies that 


(s -I- 2)(r -h 2)a:^.4y > p™, V (x, y) £ An{s) x Am{r). 


(4.5) 


Moreover, it is easy to see that for i = 1,..., n, k = 1,..., m and (i, y) G IR" x SR™, we have (s -|- 2)yPA^'^'^y = 
PA{^i^\y) s-nd (r + 2)a;Pj4^^^a; = p_ 4 (a;, edd''^hich implies that 


[s + 2)max{yP\ y £ Am{r)} = max{pyi(e^"'\ y) | y £ Am{r)} 

< max{p^(a;,y) | x G Zi„(s), y £ Am{r)} 


(4.6) 


^max 

= Pa 


for i = 1,..., n, and 


(r -I- 2)max{xP4*^^)x | x £ Zln(s)} = max{pyi(x, I * ^ 4ln(s)} 

< max{pyi(x,i/) I X £ An{s), y £ Am{r)} 

— „max 

- Pa 


(4.7) 


for k = 1,... ,m. Consequently, by (4.6) and (4.7), we know that 

n n 

E**d4l«?/<pr7(s + 2) and y^x^< pT^/ {r + 2), V x £ An{s), y £ Am{r). (4.8) 


k=l 
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By Theorem 4.1, (4.5) and (4.8), it holds that 


^(s,r) _ ('S + 2)(r + 2) 
(s + l)(r + 1) 
(s + 2)(r + 2) 


Taiin{py^{x,y) \ x G An{s),y G Am{r)} 


> 


mm 

PA 


1 


(s + l)(r + l) 

(s + 2)(r + 2) + 1 jnin 
(s + l)(r+l) 


max 

-,PA 


1 


s + 2"^ r + 2 
S “h r “H 4 max 
- (5+1)(^ + 1)P-4 


max I 

PA + 


(s + 2)(r + 2) 



The first result follows. 

The second inequality is derived by a similar way. By Theorem 4.1, there exists {x,y) G An{s) x Am{r) such 
that 


(s,r) _ (s + 2)(r+ 2) 

(s + l)(r + l)^^^ 


which implies 


(s + 2)(r + 2) ( (s,r) -T 4 (i)- , -T j 

(3 + l)(r + l) A''>y-'^yux A^>x + x AyU 


^ t 9 r t x,y^Ay 


(s + 2)(r + 2) 


k=l 


mm I max . 

\PA + TITAPA + 


By (4.9), we obtain 


(s + 2)(r + 2)^^ (s + 2)(r + 2)^-^ ' 5 + 2^^^ 'r + 2 

s + r + 4 


PA 


(s,r) min ^ 

Pa PA < 


(s + 2)(r + 2) 

We obtain the desired result and complete the proof. 


( max min \ 

PA -PA j 


(4.9) 


In the rest of this section, we consider the following standard multi-quadratic optimization problem (StMQP) 

(4.10) 


= min PA . ■ •, ' = 


\ "1 "d 

)■■= E ••• E 

S.t. j G Zini X ■ ■ ■ X A„ 


(1) (1) (d) (d) 

ft • • •yt '• ^ ^ • 'T* ^ ' 'T' ' ^ 


where A — 

For any given ri,..., r^/ G N, define 


{ri,...,rd) _ 


= min • X I +’•£’ = 1,A’G (^n),’..,’E)*} 


whose dual problem is 

p+i.-.-.rd) _ G K I ^ — Af G • 

Similarly as for StBQP, dehne 

p+i. -.'-d) ^ min|p^(a;(^E • ■ , 2 ^'^^) I £ 2\„^(’'fc), 1 < * < rfj , 

where i® defined similarly as Dehnition 3.1. Notice that we can obtain by only doing function 

evaluations at points on Z\rai(ri) x ■ • ■ x Ana{r^). 
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Theorem 4.3 For any given ri,..., £ N, one has 


(ri....,rrf) r(ri, ...,rd\d) 


Pa" -PV '’ < 


and 


Pa 


Utiin + 1) 


(ri,...,rd) min ^ 


-PA < 




max min\ 

Pa -Pa ) 


max min\ 

P.4 -PA ) , 


where p’a^^ is the maximum value of objective in (4.10) and 

r{ri,...,r^-d) := Jf. (ft + • • • (r^ + 2 )'"'^ 

+ E iri+■■■{u+2r^ +. 

u={ui,... yi^d) & {0,1}'^ ,\v\=d—3 


Proof By using similar arguments as for Theorem 4.1, we can obtain that 


(ri,...,rd) _ 11^=1 (’"f + 2 ) 


n“=i{n + i) 


min ^Pa{^^^\ • • • i 




,(rfe), fc = l,...,d|, 


where 


Pa{x^^\---,x''‘^'>) 


d nfc 


= Pa{x^^\ ■ ■ ■ ,x^'^'>) ^ 

k=l ik = l 

, V V , (1) (k-l) (k+1) (s-1) (s+1) (d)x 

l<k^sKd l<Zfc<nfc,l<2s<ns 

+ ... 

-h (-l)"*.4i...d • (g) ■ • ■ (g) 


with 


d**" = _ t _ 

rfe + 2 

1 


(®hii ■■■**;ifc+ijfc+i ...tdid )l<ii ,lG[d]\{fe} 1 *fc Ij ■ • • i ttfc, 

r(®iiii. 


"^fcs _j_ 2)(rs -|- 2) '''^bii...if!-ilfc-ijfc*fc*fc+iifc+i...is-ils-i*aisis+iis+i...idi£ill<ii,jz<ni,JG[d]\{fc,s}i 

V i}^ 1, . . . , tZ/j;, Zs l,...,Tls 


-4i...d — 


1 


■ (fliiiii2i2...idid)l<i)j<nfc,fe=l,...,d' 


(fi + 2) • • • {ru + 2) 

Moreover, since PAix^^\ ..., > p^'^, P Ak • • ■ i ..., < p^^/(r^ + 2), and so on, for 

any x^^'i £ Auk (fc = 1,..., d), by using similar arguments as for Theorem 4.2, we have 


(ri....,i-d) ^ ni=l(’'i+ 2 ) J 

+ E 

iKk^s^l^q^d 


1+ E 


l<k^s<d 


{Xk + 2)(rs + 2) 


1 


{Xk + 2)(rs -h 2)(r; + 2){rq + 2) 


+ ... 


Pa 


E (ru -£21+ E 


i<fc<d l<fc^r^Z<d 


+ ... 


Pa 


Consequently, we obtain 


min „(n.....r'd) ^ r(ri,... ,rrf;d) ^ max r(ri,... ,rrf;d) 

min 

PA -P<^ - T-rd , TTV^^ “ rrd t TrT^-^ ’ 

nz=i(^* + l) ni=i(’-* + l) 


(4.11) 
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where 


d d 

f(ri,... ,rd;d) = ]^(ri + 2) - ]^(ri + 1) + ^ (n + 2)'^ • • • (r^ + 2)'-^ 

1=1 1=1 /=(;i,..../d)G{o,i}'',|i|=d-2 

+ ^ (n + 2)'^ ■■■{ra + 2y^ +■■■. 

i = (ii,....id)G{0,l}‘i,|i|=d-4 


We claim that 


r(ri,...,rd;d) = r(ri,..., d). (4-12) 

In fact, since Y[i=ii^ ~ “i) = — {J2i=i + • • • + (—1)'^ 11^=1 “i> tiy faking x = 1 and + 2, it holds 

that 


ncri + 1) = (-1)" + + 2)*'"-' + (-1)'"-^ ^ in + 2 )(r, + 2 ) + • • • + n(^i + 2), 

i=l i=l ^=1 

which implies 


J](r,+ 2 )+ ^ + 2 )'^ • • • (rd + 2 )''^ 

i=l i=(ii,...,id)G{0,l}4,|/|=d-2 

+ ^ (n+ 2 )'i •••(rd + 2 )''*+ ••• 

i=(ii,...,;d)G{0.1}4,|Z|=d-4 

^ (n + 2)'^... (rrf + 2t 

/=(;i,..../d)G{o,i}4,|i|=d-i 

+ ^ (n + 2)'i • • • (r^ + 2)'-^ + ..., 

/=(ii,...,Zd)G{0,l}4,|i|=d-3 


- 

1=1 


and hence (4.12) holds. By (4.11) and (4.12), we obtain the first ineqnality. The second inequality can be proved 
by a similar way. □ 


From Theorems 4.2 and 4.3, we know that a PTAS for solving (1.1) exists and it can be extended to solving 
(4.10). Specially, for (4.10), we know, from Theorem 4.3, that if n = ... = r^; = r, then one has 

min (r,...,r) ^ ( max min\ 

^ + i)d [P^ -P^ ) 

and 

(r,...,r) min ^ / max min\ 

-P-4 ^j,r^[PA -PA ), 

where r(r; d) := (j)(r' + 2)'^-^ + ( 3 )(r + 2)‘^-^ + • • ■. In this case, we have 

min (r,...,r) ^ /o/i i( \ ^\\ I max min\ 

PA -Pi^ < 0(l/(»’ +1)) -PA ) 

(r,...,r) _min ^ // i o^^ i „max „min\ 

Pa Pa < 0(l/(r + 2 )) (^p _4 j. 


and 
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5 Numerical illustration 


In this section, we provide some preliminary numerical results to show that our approximation approach 
performs reliably on approximately solving StBQP. All codes were written by Matlab 2010b and all the 
numerical tests were conducted on a Lenovo desktop computer with Intel Pentium Dual-Core processor 2.33GHz 
and 2GB main memory. 

Example 5.1 This example comes from [4, Example 2], where the objective function defined in (1.1) is specified 
as 

4 3 

PA{x,y) :='^aj{xl+xl)y] + '^ 4:bjXiX2yjyj+i 
j=i 1=1 

and {x,y) G Z \2 x Aq, where the vectors a and b are respectively defined by 

a := [0.7027,0.1536, 0.9535, 0.5409]^ and b := [1.6797,1.0366,1.8092]^. 

As shown in [4], the optimal objective value of this problem is 0.0598, that is, = 0.0598. 

Example 5.2 The second one is taken from [12, Example 1], which takes the form of 

y) ■= xiyl + xlyl + xlyl -h 2{xiyl + x\y\ -|- xiy\) - 2 {xiX 2 yiy 2 + xix^yiys -|- * 2 * 3 ^ 22 / 3 ) 

and (x,y) G A 3 x A 3 . In [4] (see also [7]), the authors showed that the global optimal value of the objective 
function is 0 , that is, ^[ 4 '" = 0 . 

In the following three examples, we construct the objective function defined in (1.1) in the form of 


where A is a 4-th order tensor and Z := [xx^) ® {yy^)- 

Example 5.3 The corresponding tensor defined in (5.1) is given hy A := A® B — 2C D, where 


(5.1) 


1 2 1 


112 


A= 242 , B = \ 1 12 


C = 


12 1 , 


2 2 4, 



and D = 



The simplex constraint is {x,y) G A 3 x A 3 . We can verify that the corresponding optimal value is = —1. 
Example 5.4 We construct the tensor A defined in (5.1) hy A := A® B — C ® D with 


A = 


( 1 -3 -2 -l\ 
-3 9 6 3 

-2 6 4 2 

\-i 3 2 1 y 


B = 


[A -4-2 -2 -2\ 
-44222 
-22111 
-22111 
\-2 2 1 1 1 y 


, C = 


/-2 2 1 o \ 

2 6 5 4 
15 4 3 
VO 432 y 


, and D = 


/-4 0 -1 -1 -l\ 
0 4 3 3 3 

-1 3 2 2 2 

-1 3 2 2 2 

V-1 3 2 2 2 y 


The simplex constraint corresponds to {x,y) G A 4 x A 5 , and the global optimal value is = —4. 
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Example 5.5 For any given positive integer let be the Z-dimensional vector of ones, that is, := 

,1)^. Correspondingly, let F; be an Z x Z matrix of ones. We generate the 4-th order tensor A de- 
hned in (5.1) hy A '.= A® B — 2C (8) D, here 


A = 



_(g(n-2))T' 

2(g(n-2))T 

En-2 


( 


B = 


1 

-1 

-2 


-1 

1 

2 


-2 

2 

4 


_(e(m-3))TN^ 

(e('"-3))T 

2(e(™-3))T 


^_g(m-3) g(m-3) 


Em—3 




and 


-1 1/2 0 
C = I 1/2 2 (3/2){e("-2))T 

0 (3/2)e("-2) En-2 


D = 


(-1 0 
0 1 
1/2 3/2 

\ 0 e 


1/2 
3/2 
2 

(m-3) (3/2)e(’"-3) 


0 

(e('"-3))T 
(3/2)(e(™-3))T 
Em—3 


In addition, the simplex constraint corresponds to {x,y) G An x Am- For any n>2 and m > 3, similarly, we 
can verify that such problem attains its optimal value = —1. In our test, we focus on the case n = 5 and 
m = 8. 

Note that our approximation approach is closely related to the choices of s and r. Actually, it can be 
easily seen from Theorem 4.2 that larger s and r could lead to better approximate results. Therefore, we here 
investigate the behaviors of s and r on approximately solving the problem under consideration. More concretely, 
we test 12 groups of (s,r) in the combinations of s := {3,4,8,13} and r := {5,12,17}. The corresponding 
numerical results are summarized in Table 1, where and p)^'" represent the approximate optimal value 

and the exact optimal value, respectively. As a matter of fact, our examples might have many optimal solutions. 
Thus, we show graphically the corresponding approximate optimal solutions in Figs. 1 and 2. 


Table 1 Comparison between approximate optimal values and exact optimal values. 


i 

(s,r) 

Example 5.1 

Example 5.2 

Example 5.3 

Example 5.4 

Example 5.5 

fs,r} 

Pa 

„min 

Pa 

(s,r) 

Pa 

„min 

Pa 

(s,r) 

Pa 

-min 

Pa 

fs,r) 

Pa 

-min 

Pa 

(s,r) 

Pa 

-min 

Pa 

1 

(3,5) 

0.0666 

0.0598 

0.00 

0.00 

-1.00 

-1.00 

-4.00 

-4.00 

-1.00 

-1.00 

2 

(3,12) 

0.0668 

0.0598 

0.00 

0.00 

-1.00 

-1.00 

-4.00 

-4.00 

-1.00 

-1.00 

3 

(3,17) 

0.0665 

0.0598 

0.00 

0.00 

-1.00 

-1.00 

-4.00 

-4.00 

-1.00 

-1.00 

4 

(4,5) 

0.0600 

0.0598 

0.00 

0.00 

-1.00 

-1.00 

-4.00 

-4.00 

-1.00 

-1.00 

5 

(4,12) 

0.0601 

0.0598 

0.00 

0.00 

-1.00 

-1.00 

-4.00 

-4.00 

-1.00 

-1.00 

6 

(4,17) 

0.0599 

0.0598 

0.00 

0.00 

-1.00 

-1.00 

-4.00 

-4.00 

-1.00 

-1.00 

7 

(8,5) 

0.0600 

0.0598 

0.00 

0.00 

-1.00 

-1.00 

-4.00 

-4.00 

-1.00 

-1.00 

8 

(8,12) 

0.0601 

0.0598 

0.00 

0.00 

-1.00 

-1.00 

-4.00 

-4.00 

-1.00 

-1.00 

9 

(8,17) 

0.0599 

0.0598 

0.00 

0.00 

-1.00 

-1.00 

-4.00 

-4.00 

-1.00 

-1.00 

10 

(13,5) 

0.0603 

0.0598 

0.00 

0.00 

-1.00 

-1.00 

-4.00 

-4.00 

-1.00 

-1.00 

11 

(13,12) 

0.0605 

0.0598 

0.00 

0.00 

-1.00 

-1.00 

-4.00 

-4.00 

-1.00 

-1.00 

12 

(13,17) 

0.0602 

0.0598 

0.00 

0.00 

-1.00 

-1.00 

-4.00 

-4.00 

-1.00 

-1.00 


It is clear from Table 1 and Fig. 1 that s = 4 and s = 8 yield the best approximate results for Example 
5.1. Moreover, for a fixed s, we can easily see that larger r leads to better approximation, which also supports 
our theoretical results in Theorem 4.2. More surprisingly, the results in Table 1 corresponding to Examples 
5.2-5.5 show that our approximation strategy can exactly get the accurate optimal values in addition to finding 
different optimal solutions (see Fig. 2). Thus, our results further verify the reliability of the proposed approach. 
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0.7 

0.65 

0.6 

0.55 

0.5 


Example 5.1 


Example 5.1 


0 ) 
c 
o 

Q. 

E 
o 
o 
sz 

T 

^ 0.45 


cC 

> 0.35 




4 5 6 7 8 9 10 11 12 

The i-th group of (s,r) 


Fig. 1 Approximate optimal solutions and objective value of Example 5.1 with respect to {s,r). 


6 Conclusions 

In this paper, we suggested an approach to approximating the optimal value of StBQP. After reformulating 
the original problem as an equivalent copositive tensor programming problem, a quality of approximation was 
presented, which is based upon the approximation of the reformulated cone of copositive tensors by a serial 
polyhedral cones. The obtained quality of approximation showed that a PTAS for StBQP exists, and extended 
the previously best known approximation result on StQP due to Bomze et al [2] to StBQP version. Finally, a 
quality of approximation for StMQP was also presented. 
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